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(57) Abstract 

An image data post-prcx^essing method for reducing quantization effect induced when image data compressed based on a block is 
decoded, and an apparatus therefor. The image data post-processing method includes the steps of: (a) detecting semaphore representing 
whether or not post-processing is required, using distribution of inverse quandzation coefficients of inverse-quantized image data and a 
motion vector representing the difference between the blocks of a previous video object plane (VOP) and blocks of a current VOP; and (b) 
filtering the decoded image data corresponding to the semaphore by a predetermined method, if it is determined by checking the detected 
semaphore that post-processing is required. Therefore, the quantization effect can be reduced by using the semaphore and an adaptive filter, 
and the amount of computation for filtering is also reduced. Also, the complexity of the hardware is reduced by a parallel process without 
multiplication and division. 
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IMAGE DATA POST-PROCESSING METHOD FOR REDUCING 
QUANTIZATION EFFECT, APPARATUS THEREFOR 

5 Technical Field 

The present invention relates to image data processing, and more 
particularlyV to an image data post-processing method for reducing quantization 
effect, and an apparatus therefor. 

10 Background Art 

The present invention is adopted as ISO/IEC JTC1/SC29AVG11 N1902 
aSO/IEC 14496-2 Committee Draft). 

Generally, picture encoding standards such as MPEG of the International 
Standardization Organization (ISO) and H.263 recommended by the International 
15 Telecommunication Union (TTU) adopt block-based motion estimation and discrete 
cosme transform (DCT) of blocks. Also, most video coding standards use an 8x8 
pad blodc DCT for packing information into a few transform coefficients. Such 
block-based DCT schemes take advantage of the local spatial correlation property 
of images. 

20 However, when image data which has been coded based on blocks is 

restored, the restored image is considerably deteriorated, causing blocking artifacts 
near block boundaries, comer outliers at cross points of blocks, and ringing noise 
near the image edge. Because MPEG quantizes the transformed coefficient of 8 x8 
pixel block. In particular, when the image is highly compressed, the deterioration 

25 of the unage becomes serious. 

When an image is highly compressed, the block-based coding induces the 
well-known blocking artifacts near the block boundary, comer outliers at the cross 
points of the blocks, and ringing noise near the image edge. 

The blocking artifacts are grid noise occurring along the block boundaries 

30 in a relatively homogeneous area. The grid noise shows traces of the block-based 
process at the edges between blocks when the compressed data is displayed on a 
screen after being restored. Thus, the edges between blocks are identified. Also, 
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comer outliers occur at the comer points of the 8 X8 block. Also, the ringing noise 
is a typical Gibb*s phenomenon occurring by trancation when high-frequency 
coefficients of the DCT are quantized so as to highly compress the image. As a 
result, overlapping of image with a predetermined mterval due to the ringing noise 
5 is noticeable. 

Several methods for reducing the blocking artifacts, comer outliers and 
ringing noise, caused by bloc&based~coamg, have been suggested in the' following 
articles: [1] Lee, H.C. Kim and H.W. Park, "Blocking Effect Reduction of JPEG 
images by Signal Adaptive Filtering\ in press IEEE Trans, on Image processing, 

10 1997, [2] B. Ramanurthi and A. Gersho, Nonlinear Space Variant Postprocessing 
of Block Coded Images\ IEEE Trans, on ASSP, Vol. 34, No. 5, pp. 1258-1267, 
1986, [3] Y. Ynag, N. Galatsanos and A. Katsaggelos, Projection-Based Spatially 
Adaptive ReconstruOion of Block-Transform Compressed Images'" , IEEE Trans, on 
Image processing, Vol. 4, No. 7, pp. 896-908, July 1995, [4] Z. Xiong, M.T. 

15 Orchard, and Y.Q. Zhang, M Debloddng Algorithum for JPEG Compressed 
Images Using Overcomplete Wavelet Representations'' , IEEE Trans. Circuits Syst. 
Video TechnoL, Vol. 7, No. 2, pp. 433-437, 1997. 

In tte reference [1], 2-dimensional signal-adaptive filtering (SAP) for 
reducing quantization effect of a JPEG-decompressed image has been suggested. 

20 Also, m the reference [2], a 2-dimensional filter is used to reduce the blocking 
artifacts and a 1-dimensional filter is used to reduce staircase noise, resulting in 
good effects. In flie reference [3], an iterative image-recovery algorithm using the 
theory of projections onto convex sets (POCS) has also been proposed. 

However, the main drawback of diese algorithms is then- computation 

25 complexity. Meanwhile, post-filtering which uses over-complete wavelet 
representation which reduces the complexity of computation has been suggested by 
the reference [4]. 

However, the post-filtering method is applied only to JPEG-decompressed 
images, Also, for low bit-rate codmg, a spatio-temporal adaptive post-filtering 
30 which can be applied to a 3-dimensional subband coding has been suggested in the 
reference [5]: T.S. Liu and N. Jayant, ''Adaptive Postprocessing Algorithms for Law 
Bit Rate Video Signals\ IEEE Trans, on Image Processing, Vol. 4, No. 7, pp. 
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1032-1035, July 1995. However, this method also has computation complexity. 

Disclosure of the Invention 

To solve the above problems, it is an objective of the present invention to 
5 provide an image data post-processing method for reducing quantization effects 
such as blocking artifacts, comer outliers and ringing noise, from an MPEG- 
decompressed^image, which can perform "low Bit rate codi^^withouTcom^^ 
computation, and an apparatus therefor. 

According to an aspect of the present mvention, there is provided an image 
10 data post-processing method for reducing quantization effect induced when image 
data compressed based on a block is decoded, the method comprising the steps of: 
(a) detecting semaphore representing whether or not post-processing is required, 
using distribution of inverse quantization coefficients of inverse-quantized image 
data and a motion vector representing the difference between the blocks of a 
15 previous video object plane (VOP) and blocks of a current VOP; and (b) fdtering 
the decoded image data correspondmg to the semaphore by a predetermined 
method, if it is det^mined by checking the detected semaphore that post-processing 
is required. 

Preferably, the step (a) is performed on an intra-VOP in an intra-VOP 
20 mode, and on in inter-VOP ui an inter-VOP mode. 

Preferably, the semaphore includes a blocking semaphore representing 
whether or not reduction of blocking artifacts near block boundaries is requured, 
and a ringing semaphore representing whether or not reduction of ringing noise 
near image edges is required. 
25 Preferably, the blocking semaphore and the ringing semaphore of the intra- 

VOP are detected by investigating distribution of inverse quantization coefficients 
which are discrete cosine transform (DCT) coefficients after the compressed 
bitstream is inverse quantized. 

Preferably, the blocking semaphore of the intra-VOP comprises a horizontal 
30 blocking semaphore (HBS) and a vertical blocking semaphore (VBS), assuming that 
the uppermost and leftmost pixel of the block, among 64 pixels constitutmg the 
8 x8 block, is pkel A, the pixel to the right of the pixel A is a pixel B, and the 
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pixel below the pixel A is a pixel C, and the HBS and the VBS of the intra-VOP 
are extracted by the steps of: (a) calculating discrete cosine transform (DCT) 
coefficients on the inverse-quantized 8x8 block after the compressed image data 
is inversely quantized; (b) setting the HBS and the VBS to "1" which means that 
5 post-processing is required, if only the coefficient of the pixel A is non-zero; (c) 
setting the VBS to "1" which means that post-processing is required, if only the top 
row of the inverse-quantized 8x8 block includes non-zero coefficient pixel; and (d) 
setting the HBS to "1" which means that the post-process is required, if on the 
leftmost column of the inverse-quantized 8x8 block includes non-zero coefficient 
10 pixel. 

Preferably, assummg that the uppermost and leftmost pixel of the block, 
among 64 pixels constituting the 8 x8 block, is pixel A, the pixel to the right of the 
pixel A is a pixel B, and the pixel below the pixel A is a pixel C, the ringing 
semaphore (RS) of the intra-VOP is set to "T which means post-processmg is 

IS required, if any pixel other than the pixels A, B and C of the inverse-quantized 
8x8 block has a non-zero coefficient. 

Preferably, the blocking semaphore of the current inter-VOP comprises a 
horizontal blockmg semaphore (HBS) and a vertical blockmg semaphore (VBS), 
and assumii^ that a reference VOP comprises predetermined reference blocks, and 

20 the block of the reference VOP predicted by a motion vector (MVx,MVy) of a 
block Ac of the current inter-VOP is a motion block X, the HBS and the VBS of 
on the block Ac of the current inter-VOP are extracted by the steps of: checking 
the degree of overlapping between the motion block X and the reference blocks; 
performing a bit-wise AND operation on the HBS and VBS of the reference blocks 

25 in which the number of the overlapped pixels is more than a predetermined 
number; and setting the HBS and the VBS of the block Ac of the current VOP to 
the result of the operation. 

Preferably, assuming that a reference VOP comprises predetermined 
reference blocks, and the block of the reference VOP predicted by a motion vector 

30 (MVx,MVy) of a block Ac of the current inter-VOP is a motion block X, the 
ringing semaphore (RS) of the block Ac of the current inter-VOP is extracted by 
the steps of: setting the RS of the current block Ac to "1" if an inverse quantized 
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coefficient (IQC) of a residual signal in the 8x8 block of the inter- VOP is non- 
zero; setting the RS of the block to "1" in an 8x8 prediction mode which is 
supported by the MPEG-4 algorithm and transfers four motion vectors on one 
macroblock (MB); and checking the degree of overlapping between the motion 
5 block X and the reference blocks, if the RS is still zero, and performing a bit-wise 
OR operation on the RS of the reference blocks in which the number of the 
overlapped pbcels is more than a predetermined number, to set the RS of the block 
Ac of the current VOP to the result of the operation. 

Preferably, filtering is performed by the steps of: (a) changing a 
10 predetermined number of pixel values of a horizontal block boundary between a 
block I and a block J adjacent to the block I if the HBSs of the blocks I and J are 
set to T; (b) comparing the difference between the values of two pkels adjacent 
to each other around die horizontal block boundary with a quantization factor (QP) 
of the H.263 if the HBS of either the block I or the block J is zero, and changing 
IS &e values of the pbcels whose number is less than in (he step (a) if the difference 
of the pixels is less than the QP, wherein the filtering on the pixels aroimd the 
vertical block boimdary is performed using the VBS in the same manner as in the 
pixels aroimd the horizontal block boundary. 

Preferably, assummg six pixels around the horizontal block boimdary 
20 between die blodcs I and J are pixels A, B, C, D, E and F, the pixels C and D are 
nearest to the horizontal block boimdary, the pixels A and F are farthest to the 
horizontal block boundary, and the pixels B and E are located at the middle of the 
pixels A and C, and pkels D and F, low-pass filtering on the 6 pixels is performed 
using a 7-tab (1,1,1,2,1,1,1) low pass filter in the step (a), and the filtermg of the 
25 step (b) is performed on the pixels B, C, D and E, wherein assuming that the 
difference between the pixels C and D is d, the pixels C and D are filtered as an 
average of the pixels C and D, and the filtered pbcels B and E are different from 
the pixels B and E, respectively, by d/8. 

Preferably, the filtering step comprises the steps of: detecting horizontal and 
30 vertical edges of image data; and performmg 2-dimensional adaptive signal filtering 
on an 8x8 block requiring reduction of ringing noise, wherein assuming that a 
pixel within a block having a predetermined size is pixel[m][n], the pixel to the 
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right Of the pixel[m][n] is pixeltm][n+l], the pixel to the left of the pixel[m][n] is 
pixel[m][n-l]. the difference between the pixcl[m][n] and the pixel[m][n+l] is 
Al, and the difference between the pixel[m][n] and the pixeltm][n+l] is A2, and 
the quantization factor of the H.263 is QP, the horizontal edge detection is 
5 performed by a logical formula ((A1>QP) and (A2>QP)) or (A1>2QP) or 
(A2>2QP) wherein the pixel[m][n] is determined as edge and edge map 
Edp[m][n] is' set to "1" if the logical formula Is^isfiedT^a^ass^^ that the 
pixel above the pixel[m][n] is pixel[m+l][n], the pixel below the pixel[m][n] is 
pixel[m-l][n], the difference between the pbcel[m][n] and the pixel[m+l][n] is 

10 A'l, the difference between the pixel[m][n] and the pixel[m— l][n] is A'2, and the 
quantization factor of the H.263 is QP, the vertical edge detection is performed by 
a logical formula ((A'1>QP) and (A'2>QP)) or (A'1>2QP) or (A'2>2QP) 
wherein the pixel[m][n] is determined as edge and edge map Edge[m][n] is set to 
"l** if die logical formula is satisfied, and signal adaptive filtering is performed by 

is applying a 4-connected filter window to the 8x8 block, wherein filtering is not 
performed if the central pixel of the filter window is an edge, and weighted 
filtering is performed if the central pixel of the filter window is a non-edge pixel. 

Also, there is provided an image data post-processing method for reducing 
comer outliers occurring at the comer of a cross point where four blocks meet 

20 when image data onnpressed based on a blodc are decoded, the method comprising 
the steps of: (a) detectiiig comer ootli^ from the block of inverse-quantized image 
data; and (b) compensating for the detected comer outliers. Assummg that four 
pkels around the cross point are pixels A, B, C and D, value[0] is A, value[l] is 
B, value[2] is C, value[3] is D, (A+B+C+D+2)/4 is Average, and are 

25 pixels adjacent to the pixel A in the block to which the pixel A belongs, ^ is a 
pixel diagonal to the pixel A, jB, and are pixels adjacent to the pixel B in the 
block to which the pkel B belongs, ^3 is a pbcel diagonal to the pixel B, Cj and 
are pbcels adjacent to the pixel C in the block to which the pixel C belongs, is 
a pbcel diagonal to the pbcel C, Z), and are pbcels adjacent to the pixel D in the 

30 block to which the pucel D belongs, and is a pixel diagonal to the pixel D, the 
step (a) may comprise the sub-steps of: (al) comparing the difference between the 
value[0] and the Average with the quantization factor (QP) of the H.263, and 
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counting the pixel A as the comer outlier candidate pixel if the difference is greater 
than the QP; (a2) performing the step (al) on the value[l], value[2] and value[3] 
to count the corresponding pixel as a comer outlier candidate pixel; and (a3) 
detecting the pixel as a comer outlier pixel if the comer outlier candidate pixel is 

5 only one, and detecting the candidate pixel having the greatest difference from 
(A3+B3+C3-fD3+2)/4 as a comer outlier pixel if there are two or more comer 
ouflier candidate pixels. Also, the step (b) may be performed by compensating for 
the pbcel A as A' by (4A+B -fC +2D +4)/8, the pixel Ai as Aj ' by (A' +3A +2)/4, 
the pixel Aj as A^' by (A' +3^ +2)/4, if the comer outlier pixel is A and the 

10 difference between the pixels A and A3 is less than 3QP/2; compensating for the 
pkel B as B' by (4B+C+D+2A+4)/8, the pkel B, as Bi ' by (B'+3Bi +2)/4, the 
pixel B2 as ' by (B' +B^ +2)/4, if the comer outlier pkel is B and the difference 
between the pixels B and B3 is less than 3QP^; compensating for the pixel C as C 
by (4C+D+A+2B+4)/8, the pbcel Q as Q' by (C'+3Q +2)/4, the pixel Q as 

15 Q' by (C'+3C2+2)/4, if the comer outlier pfatel is C and the difference between 
the pbcels C and Q is less than 3QP/2; and compensating for the pixel D as D' by 
(4D+A+B+2C+4)/8, the pixel as by (D'+3El -f2)/4, the pbtel Q as I) ' 
by 05'+3D2+2)/4, if the comer outlier pixel is D and the difference between the 
pbcels D and D3 is less than 3QP/2. 

20 Also, there is provided an image data post-processing method for reducing 

quantization effect induced when image data compressed based on a block is 
decoded, tte method comprising the steps of: (a) detecting semaphore representing 
whether or not post-processing is required, using distribution of inverse 
quantization coefficients of inverse-quantized image data and a motion vector 

25 representing the difference between blocks of previous video object plane (VOP) 
and blocks of a current VOP; (b) detecting a comer outlier pixel of the inverse- 
quantized image data block, by the above steps used in the above image data post- 
processing mediod for reducing the comer outliers; (c) filtering the decoded image 
data corresponding to the semaphore by a predetermined method, if it is determined 

30 by checking the detected semaphore, that the post-process is required; and (d) 
compensating for the detected comer outlier through the steps used, in the above 
image data post-processing method for reducing the comer outliers. 
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According to another aspect of the present mvention, there is provided an 
image data post-processing apparatus for reducing quantization effect induced when 
image data compressed based on a block is decoded, the apparatus comprising: a 
semaphore detector for detecting a semaphore representing whether or not post- 
5 processing is required, using distribution of inverse quantization coefficients of 
inverse-quantized image data and a motion vector representing the difference 
between blocks of previous video object plane (VOP) and blocks of a current VOP; 
a deblocking filter for checking blocking semaphore detected by the semaphore 
detector and perfonning deblocking filtering on the decoded image data; a comer 

10 oudier compensator for detecting a comer outlier from the data passed through the 
deblocking filtering and compensating for the detected comer outlier; and a 
deringing filter for checking ringing semaphore detected by the semaphore detector 
and perfomiing deringing filtering on the comer outlier compensated data. 

Also, the present invention may be embodied as a program capable of being 

IS run by a conq>uter, and may be embodied in a general purpose digital computer that 
is running the program from a computer usable medium including but not limited 
to storage media such as magnetic storage media (e.g., ROM's, floppy disks, hard 
disks, etc.), optically readable media (e.g., CD-ROMs, DVDs, etc.) and carrier 
waves (e.g., transmissions over the Internet). 

20 According to still anodier aspect of the present invention, there is provided 

a computer readable medium having embodied thereon a computer program for 
image data post-processing for reducing quantization effect induced when image 
data compressed based on a block is decoded, wherein the image data post- 
processing comprises the steps of: (a) detecting semaphore representing whether or 

25 not post-processing is required, using distribution of inverse quantization 
coefficients of inverse-quantized image data and a motion vector representing the 
difference between the blocks of a previous video object plane (VOP) and blocks 
of a current VOP; and (b) filtering the decoded image data corresponding to the 
semaphore by a predetermined method, if it is determined by checking the detected 

30 semaphore that post-processing is required. 
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FIG. 1 is a block diagram of a decoder for decoding a block-based coded 
image data, and an image data post-processing apparatus for reducing quantization 
effect occurring when an image is decoded by the decoder; 

FIG. 2 shows a block diagram of an MPEG-4 decoder and an 8x8 DCT 
5 coefficient block which is inversely quantized by an inverse quantizer of the 
decoder; 

FIG. 3 shows flie relationship of an 8x8 block of an inter video object 
plane (VOP) and adjacent blocks of a reference VOP; 

FIG. 4 is a diagram illustrating an example of extraction of a horizontal 
10 blocking senuphore (HBS), a vertical blocking semaphore (VBS) and a ringing 
semaphore (RS) for the inter-VOP; 

FIG. 5 shows a block boundary and a pixel position of the block boundary, 
for illustrating the operation of a deblocking filter for reducing blocking artifacts; 
FIG. 6A is a one-dimensional view showing an example of blocking 
IS artifacts; 

FIG. 6B shows the result of 7-tab filtering performed on the decoded pbcel; 

FIG. 6C shows the result of weak filtering performed on the decoded pbcel; 

FIG. 7A shows an example of image edge in which the comer outlier is due 
to the quantization, FIG. 7(B) shows the comer outlier occurred by the 
20 quantization, and FIG. 7(C) shows coordmation values at the comer points for 
compensating for the comer outlier; 

HG. 8 A shows a kernel of a 2-dimensional signal adaptive filter (2-D SAF); 

and 

HG. 8B shows examples of a 10x10 block for edge detection and SAF. 

25 

Best mode for carrving out the Invention 

In HG. 1, a decoder 20, which is a general decoder, decodes block-based 
image data and an image data post-processing apparatus 10 for reducing 
quantization effect occurring when the decoder 20 decodes an image, includes a 
30 semaphore extractor 100, a deblocking filter 110, a comer outlier compensator 120 
and a deringing filter 130. 

The semaphore extractor 100 extracts a semaphore using the distribution of 
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inverse quantization coefficients (IQCs) of an image data that has been inverse- 
quantized, and a motion vector representing the difference between the previous 
video object plane (VOP) and the current VOP. 

The semaphore is information representing whether or not the decoded 
5 image requires post-processing, and is divided into a blocking semaphore and a 
ringing semaphore. The blocking semaphore represents whether or not there is 
need for reducing blocking artifacts near the blocking boundary, and the ringing 
semaphore represents whether or not tiiere is need for reducing the ringing noise 
near the image edge. Also, the blocking semaphore is constituted by a horizontal 
10 blocking semaphore (HBS) representmg whether or not post-processing on pixels 
of adjacent block of a horizontal block boundaiy line is required, and a vertical 
blockmg sem^hore (VBS)repi:esenting whether or not post-processing on the pixels 
of adjacent block of a vertical block boundaiy line is required. 

Also, die semaphore extraction is perfonned on an intra-VOP and an inter- 
15 VOP. The sonaphore extraction on the inlra-VOP is perfonned using distribution 
of IQCs of the inverse-quantized image data. The sem^hore extraction on the 
inter-VOP is based on a motion vector representing the difference between the 
previous VOP and the current VOP. 

The deblocking fdter 110 checks the blocking semaphore extracted from the 
20 semaphore extractor 100 using an one-dimensional horizontal and vertical low pass 
filter (LPF), and performs deblocking filtering on the decoded image data. 

The ouflier compensator 120 detects a comer outiier of the data passed 
through the deblocking filter 110, and compensates for the detected comer outiier. 

The deringing filter 130 checks the ringing semaphore extracted by the 
25 semaphore extractor 100 using a 2-dimensional signal adaptive filter (2-D SAP), 
and performs deringing filtering on the comer outiier compensated data. 

Meanwhile, the operation of the present invention will be described in detail 
in the following embodiments. According to the basic concept of the image data 
post-processing method of the present invention, quantization effect is adaptively 
30 reduced by using spatial frequency and temporal information. 

Also, in die present invention, subjective image quality, peak signal to noise 
ratio (PSNR) and complexity of computation are considered. Particularly, the 
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computation complexity is a veiy important factor in the MPEG-4 when the basic 
concept is implemented by software and hardware. In order to extract the 
semaphores of the blocking artifacts and ringing noise in every 8x8 block, 
distribution of the quantization coefficients in a frequency domain and a motion 
5 vector is investigated. A blocking semaphore and a ringing semaphore arc used, 
so that a l-dunensional low pass filter (1-D LPF) and a 2-D SAF are adaptively 
used in every 8 x8' block: 

First, the semaphore extraction from the blocking artifacts and ringing noise 
by the semaphore extractor 100 will be explained. 

10 

1. The semaphore for blocking artifacts and ringing noise 
In order to reduce the number of computations and to perform an efficient 
reduction of the quantization effects in the MPEG-4, two kinds of semaphores are 
defined: the blocking s^naphore and the ringing semaphore. The blocking and the 
IS ringing semaphores are extracted from the DCT domain of each 8x8 block in the 
mtra-video object plane (VOP). Also, the semaphores of the inner-VOP are 
calculated from both the residual signal and the semaphores of the reference VOP. 

1 . 1 Semaphore extraction for intra-VOP 
20 The distribution of the inverse quantized coefficient (IQC), the DCT 

coefficients after inverse quantization, is investigated. FIG. 2 shows the decoder 
block diagram of the MPEG-4. In the 8x8 inverse quantized block of FIG. 2, the 
coefficients A, B and C are used for deciding the blocking and the ringing 
semaphores. 

25 When only the coefficient in position A of FIG. 2 has a non-zero value, the 

64 pixels of the 8x8 decoded block have the same value in the spatial domain; 
therefore, a block having only a DC component can induce horizontal and vertical 
block artifacts. In this case, both the horizontal semaphore (HBS) and the vertical 
blocking semaphore (VBS) of the block are set to "1". 

30 When only the coefficients in the top row of the 8x8 inverse quantized 

block have non-zero values, the eight pixels in each column have the same value 
in the spatial domain. This block may induce vertical blocking artifacts, to the 



wo 99/22509 



PCT/KR98/00311 



12 

VBS is set to "1". When only the coefficients in the far left colunin ^ve non-zero 
values, the eight pixels in each row have the same value in the spatial domain. 
This block may induce horizontal blocking artifacts, so the HBS is set to "r. 

The ringing semaphore (RS) is set to "1" if any non-zero coefficients exist 
5 in positions other than A, B and C m FIG. 2. These high-frequency coefficients 
mean that the block includes image edges. Therefore, the block produces ringing 
noise around the hnage edges du€rto~tKe~tmncatioiri5f^ t^^ high-frequency 
coefficients. 

These three noise semaphore, HBS, VBS and RS, are stored in three bits 
10 for each block. No additional calculation is required to extract the semaphores. 

1.2 Semaphore propagation for inter-VOP 

The blockmg and the ringing semaphores in the reference VOP are 
propagated to the next mter-VOP by using the motion vectors. Also, the residual 
15 signal of the inter-VOP is used to decide of the semaphores of the inter-VOP. 

First, the propagation of flie blocking semaphore from the reference VOP 
. to the inter-VOP will be described. 

FIG. 3 shows the relations of the 8x8 block, Ac, m the inter-VOP to the 
adjacent blocks of the reference VOP. The propagation of the blocking semaphore 
20 is described by the motion vectors MVx and Mvy as follows. 

In FIG. 3, At, Br, Cr and Dr represents blocks of the reference VOP, and 
Ac is a block of the current inter-VOP, and X is a motion block of the block Ac. 
The motion block X is estimated using the motion vector O^x, MVy). First, the 
degree of overlapping between the motion vector X and the reference blocks is 
25 investigated). The HBS and VBS of the current block Ac can be calculated by 
performing a bit-wise operation on the HBS and VBS of the reference blocks which 
are overlapped by the motion-estimated block X, provided that only those blocks 
for which the overlapped regions are wider than 2x2 pixel, respectively, are used 
in this calculation. 

30 For example, when MVx and MVy are equal to 5 and 3.5, respectively, the 

motion-estimated block X overlaps with four reference blocks Ar, Br, Cr and Dr. 
Here, four overlapping regions are all wider than a 2x2 pixel. Thus, the HBS and 
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VBS of flie current block Ac can be calculated from the four reference blocks Ar, 
Br, Cr and Dr as shown in FIG. 4. In FIG. 4, represents a bit-wise AND 
operation, and " | " represents a bit-wise OR operation. 

Next, the propagation of the ringing semaphore from the reference VOP to 
5 the inter-VOP will be described. 

First, the RS of the reference block Ac is set to "1" if any IQC of the 
^resiilual~signats ~in""8 x8 block of the inter- VOP~ir¥6n-zero: Tfi^lyIPEG-4 
algorithm supports an 8x8 prediction mode which transmits four motion vectors 
for one macroblock (MB). The 8x8 prediction mode is usually applied to a busy 

10 area havmg high-frequency components. Thus, the RS of the block having an 8 x8 
prediction mode is set to " 1 " after checking whether or not the block has the 8 x 8 
prediction mode. If the RS is still equal to ''O" after the above decisions, the RS 
of the current block Ac can be calculated in the same manner as in the blocking 
semaphore, by performing the bit-wise OR operation on the RS of the reference 

15 blodcs for whidi the overlapping regions are wider than 2x2 pfacels. An example 
of the RS operation is shown in FIG. 4. 

2. Image data post-processing method using semaphore 
The deblocking filter 110, the comer outlier compensator 120 and the 
20 deringing filter 130 will be described m detail. 

2.1. Deblocking filter for reducing blocking artifacts 
A 1-dimensional LPF for reducing blocking artifacts is strongly or weakly 
performed, depending on the blockmg semaphore on the horizontal and vertical 

25 block boundaries. In order to reduce the blocking artifacts, most deblocking 
algorithms compute image-edge information and adaptively apply a LPF adaptively 
based on the image-edge detection. However, the proposed deblocking algorithm 
of the present invention does not require image-edge detection which needs a large 
number of computations, because it utilizes the above-obtained blocking semaphore. 

30 The 8x8 block to be processed and the adjacent blocks are shown in FIG. 

5. If the HBS of BLOCM and the HBS of BLOCKJ are both set to T, a 7-tab 
(1.1,1,2,1,1,1) LPF is applied to pbcels A, B, C. D, E and F of the horizontal 
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block boundary of FIG. 5. Horizontal deblocking filtering can be expressed by the 
following algorithm. 

If (HBS of BLOCK-I == 1 andHBS of BLOCK-J == 1) 
5 7-tab filtering: //change A, B, C, D, E and VII 

else 

>if(|D-=:C-|X.QP) . 

weak filtering;; //change B, C, D and E// 

10 In the above, if the horizontal blocking semaphores of BLOCK-I and 

BLOCKJ are set to "1", values of a predetermined number of pixels placed around 
a horizontal block boundary between BLOCK-I and BLOCK-J are changed. The 
filtering is performed on the above six pixels using the 7-tab (1,1,1,2,1,1,1) US. 
If any horizontal blocking semaphore of the BLXXX-I and BLOCK-J is "0" , 

15 the difference between the pixel values of two adjacent pixels placed around the 
horizontal block boimdary, and QP which is the quantization factor of H.263, are 
compared. If the pixel value difference is smaller than QP, smaller number of 
pixel values compared with the filtering using the 7-tab filter are changed. That 
is, when filtering the pixels B, C, D and E, the pixel values of the pixels C and D 

20 are averaged while the pixel values of the pixels B and E are changed by d/8, 
where d is the diffocnce between the pixels C and D. 

FIG. 6A shows an example of a 1-dimensionaI view of the blockmg 
artifacts, FIG. 6B shows the result after the 7-tab filtering is performed, and FIG. 
6C shows the result after weak filtering is performed. The weak filtering is 

25 performed when the difference in the block boundary, d= |D-C | , is smaller than 
QP. Here, the parameter QP is the quantization factor of H.263. The MPEG-4 
supports H.263 quantization. In the case of week filtering of FIG. 6C, the 
boundary pixels C and D are averaged, and also the adjacent pixels B and E are 
slightly changed to smooth the blockmg artifacts. 

30 The deblocking filtering of the present invention changes the pixel values 

on the block boundary in order to reduce the 1-D artificial discontinuity. The 
pixels around the vertical block boundary are filtered using the vertical blocking 
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semaphore in the same maimer as in the blocks around the horizontal block 
bomidary. That is. the vertical filtering is performed in the same manner as in the 
horizontal filtering. The deblocking algorithm of the present invention can be 
implemented in hardware by block-based parallel processing, and requires only shift 
5 and addition operations for 7-tab filtering and weak filtering. For example, in the 
case of the 7-tab filtering, a value C obtained by filtering a pixel C is calculated 
by C'=(A+A+B+2C+D~+E¥FT4)78^HicB:u^ and addition 

operations. 

10 2.2. Comer outlier compensator 

A comer outlier is characterized by a pixel which is either much larger or 
much smaller than the neighboring pixels in the comer point of an 8x8 block of 
the MPEG-decompressed image as shown in FIGs. 7A, 7B and 7C. When a dark- 
gray region is distributed over four blocks and one or two pixels of the dark-gray 

IS region are located in the comer pomts of the neighboring pixels as shown in FIG. 
7(A), die comer points can be distorted by quantization of the DCT coefficients as 
show in FIG. 7(B). Such distorted comer point is called a comer outlier. The 
comer outlier cannot be removed by deblocking and deringing filters. In order to 
reduce the comer outlier, die comer oudier must be detected and then compensated 

20 for. A simple coordination for comer outlier detection is shown in FIG. 7(C), 
wl^ie A« B, C and D are the pixel values of the comer points of the 8x8 blocks. 
The algorithm for the comer outlier detection can be expressed as follows: 

value[0] = A; value[l] = =B; 
25 value[2] = C; value[3] = D; 
Average = (A+B+C-f D+2)/4; 
Count = 0; 

for(m=0; m<4; m++) 

if ( I value[m] - Average | > QP) 
30 Count+ + ; /*the number of candidate points*/ 

where QP represents the quantization factor of H.263, and "Count" is a variable 
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is 



20 



25 



for storing the number of candidate comer outlier pixels. If the "Count" is zero, 
there is no comer outlier. If A is the only candidate point in FIG. 7(C) and 
I A- A3 1 is less than 3QP/2, comer-outlier compensation is performed on A, ^ 
and A2 as foUows. Assuming tbst die compensated values on A, 4 and ^ are A', 
A'l and Aj , the compensated values A', ^' andjA' are determined by the 
following formula (1). 



If the nimiber of candidate points is more than 2, the candidate which has 
the largest difference from (A34-B3+C3+D3+2)/4 is selected, and comer-ouflier 
compensation is performed on that point in the same manner as in the case of only 
one candidate. 

2.3. Deringing filter for reducing ringing noise 

Prior to applying the deringing filtering for each block, the RS is 
investigated. If the RS of the current block is deringing filtering is applied to 
that block. In order to prevent the image details fix)m bemg distorted by filtering, 
simple edge detection is performed before filtering. As shown in FIGs. 8A and 
SB, edge detection and 2-dimensional signal adaptive filtering (2-D SAF) are 
applied to an 8x8 block with a non-zero ringing semaphore. The 2-D SAF is 
^plied to 4x4 pixels located at the center of the 8 x8 block, because the boundary 
pixels are smoothed by deblocking filter. 

First, edge detection will be explained. One-dimensional (1-D) horizontal 
and vertical gradient operators are applied to the reconstmcted blocks so as to find 
the image edges. The threshold value for deciding the edge pixels is selected from 
the quantization factor QP of the H.263. For applying 2-D SAF to 4x4 pixels, 
edge information must be obtained for a 6x6 block, which is the current block, as. 
shown in FIG. 8B. Assuming that there are a pixel[ml[n] and a pbcel[m][n+l] 
which is the pfacel to the right of the pixel[m][n], and a pixel[m][n- 1] which is the 



A' = 



(4A+B+C+2D+4)/8 
= (A'+3Aj-h2)/4 
= (A'-h3A2-h2)/4 




(1) 
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pixel to the left of the pixel[m][n], the difference between the pixel[m][n] and 
pixel[ni][n+l] is Al, the difference between the pixel[m][n] and pixel[m][n-l] is 
A2, and quantization factor of the H.263 is QP, the horizontal edge detection is 
performed by the following logical formula ((A1>QP) and (A2>QP)) or 
5 (Al >2QP) or (A2>2QP). If the logical formula is satisfied, the pixel[m][n] is 
determined as an edge and the edge map Edge[m][n] becomes 1. 

' " >tesuming~that~there are a pixel[m][n], a pixel[m+l][h] whiclTisTfiepixel 
above the pixel[m][n], and a pixel[m — l][n] which is the pixel below the 
pixel[m][n], difference between the pixel[m][n] and pixel[m+l][n] is A'l, the 

10 difference between the pixel[m][n] and pixel[m-l][n] is A'2, and quantization 
factor of the H.263 is QP, the horizontal edge detection is performed by the 
following logical formula ((A'1>QP) and (A'2>QP)) or (A'1>2QP) or 
(A'2>2QP). If the logical formula is satisfied, the pixel[m][n] is determined as 
an edge and the edge map £dge[m][n] becomes 1. 

15 The edge map, Edge[ml[n], is obtained from the pixel value, pixel[m][n], 

by the following algorithm. 

/* horizontal edge detection */ 
Al = |pixel[m][n]-pkel[m][n+l]|; 
20 A2 = |pbcel[m][n]-pixel[ml[n-ll|; 

if(((Al >QP) and (A2>QP)) or (A1>2QP) or (A2>2QP)) 

Edge[m][n] = 1; 
else{ /*vertical edge detection*/ 

A'l = |pixel[m][n]--pixel[m+l][n]|; 
25 A'2 = |pixel[m][n] -pbcel[m- l][n] | ; 

if (((A'1>QP) and (A'2>QP)) or (A'1>2QP) or (A'2>2QP)) 

Edge[m][n] = 1; 

} 

30 Next, deringing filtering using a 2-dimensional signal adaptive filter (2-D 

SAP) will be described. The deringing filtering is proposed to smooth the ringing 
noise without significant loss of image details. The deringing filtering of the 
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present invention is a simple convolution operation in which weighting factors for 
the convolution vary according to flie edge map. The SAF is applied to the decoded 
block by using Edge[m][n]. HG. 8A shows a kernel for the 2-D SAF. When the 
central point A of the fUter window in FIG. SB is on the edge pixel, the 2-D 
5 filtering operation is not performed (EX.1 of FIG. 8B). If an edge point is not 
included in the 4-connected filter window, low-pass filtering is performed (EX.2 

of FIG. 8B). If some-edge-points-not-on-the-eenter~point,-are in the 4-connected-^ 

filter window, weighted filtering to exclude the edge pixels is performed (EX. 3 of 
FIG. 8B). The weightmg factors are defined in consideration of computation 

10 complexity, so SAF filtering can be performed by simple shift and addition 
operations as shown in Table. 1. 



Table 1 
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A=(4A+B+C+D+E+4)/8 
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A=(4A+B+2C+D+4)/8 
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A=(4A+2B+C+D+4)/8 


0 
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A=(A+D+l)/2 


0 


1 


1 


1 
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In Table 1, "0" represents a non-edge, and "1" represents an edge. 

The present invention may be embodied as a program capable of being run 
by a computer, and the invention may be embodied in a general purpose digital 
5 computer that is running the program from a computer usable medium including 
but not limited to storage media such as magnetic storage media (e.g., ROM's, 
floppy disks.Tiard disks, etc.), optically readable media (e.g., CD-ROMs, DVDs, 
etc.) and carrier waves (e.g., transmissions over the Internet). 

10 Hence, the present invention may be embodied as a computer usable 

medium having a computer readable program code unit embodied therein for image 
data post-processing for reducing quantization effect induced when image data 
compressed based on a block is decoded, the computer readable program code 
means in the computer usable medmm comprising: conq)uter readable program 

IS code means for detecting semaphore representing whether or not post-processing 
is required, using distribution of mverse quantization coefficients of inverse- 
quandzed image data and a motion vector rq>resentmg the difference between the 
blocks of a previous video object plane (VOP) and blocks of a current VOP; and 
computer readable program code means for filtering the decoded image data 

20 corresponding to the semaphore by a predetermined method, if it is determined by 
checking the detected semaphore that post-processing is required. 

A functional program, code and code segments, used to implement the 
present invention can be derived by a skilled computer programmer from the 
description of the invention contained herein* 

25 When images are highly compressed, the decompressed images produce 

quantization effects such as blocking artifacts, comer outlier and ringing noise. As 
described above, the post-processing method of the present invention reduces the 
quantization effects of the decomposed images by using semaphores and adaptive 
filters. The blocking and ringmg semaphores of each block greatly contribute to 

30 reducing the computation complexity of post-filtering. The motion vectors in the 
inter- VOP are used to extract the blocking and the ringing semaphores for the 
current block. 
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In video coding, both die computatbn complexity and the PSNR must be 
considered for hi^ image quality and for easy implementation in the hardware and 
software. From flie aspect of hardware complexity, the algorithm of the present 
invention can be performed by parallel processing without multiplication and 
5 division operations. 

— Industtial-Applicability 

The post-processing method of the present invention can be widely used, 
because it significantly enhances the subjective quality while maintaining image 
10 details. The proposed algorithm of the present invention can be applied to JPEG, 
H.263+, MPEG-1 and MPEG-4 decompressed images. 
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What is claimed is: 

L A method of detennining whether or not to perform post-processing 
for reducmg quantization effect induced when image data compressed based on a 
block is decoded, wherein the determmation is performed with reference to 
5 distribution of inverse quantization coefficients of inverse-quantized image data in 
an intra video object plane (VOP) coding mode, and a motion vector representing 
"* the difference between the blocks of previous VOP and the blocks of the current 
VOP in an inter- VOP coding mode. 

2. An image data post-processmg method for reducing quantization 
10 effect induced when image data compressed based on a block is decoded, the 

method comprising the steps of: 

(a) detecting semaphore representing whether or not post-processing is 
required, \jsing distribution of inverse quantization coefRcients of inverse-quantized 
image data and a motion vector representing the difference between the blocks of 

15 a previous video object plane (VOP) and blocks of a current VOP; and 

(b) filtering (he decoded image data correspondmg to the semaphore by a 
predetermined method, if it is determmed by checking the detected semaphore that 
post-processing is required. 

3. The method of claim 1, wherein the step (a) is performed on an 
20 intra-VOP in an intra-VOP mode, and on in mter-VOP in an inter-VOP mode. 

4. The method of claim 3, wherein the semaphore includes a blocking 
semaphore representing whether or not reduction of blocking artifacts near block 
boundaries is required, and a ringing semaphore representing whether or not 
reduction of ringing noise near image edges is required. 

25 5. The method of claim 4, wherein the blocking semaphore and the 

ringmg semaphore of the intra-VOP are detected by investigating distribution of 
inverse quantization coefficients which are discrete cosine transform (DCT) 
coefficients after the compressed bitstream is inverse quantized. 

6. The method of claim 5, wherein the blocking semaphore of the intra- 

30 VOP comprises , a horizontal blocking semaphore (HBS) and a vertical blocking 
semaphore (VBS), assuming that the uppermost and leftmost pixel of the block, 
among 64 pbcels constituting the 8x8 block, is pbcel A, the pixel to the right of the 
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pixel A is a pixel B, and the pixel below the pixel A is a pixel C, and the HBS and 
the VBS of the intra-VOP are extracted by the steps of: 

(a) calculating discrete cosine transform (DCT) coefficients on the inverse- 
quantized 8x8 block after the compressed image data is inversely quantized; 
5 (b) setting the HBS and the VBS to "1" which means that post-processing 

is requu-ed, if only the coefficient of the pixel A is non-zero; 

^(c) setting the VBS to 'T which meafirtHat"post^^pfoce^ if 
only the top row of the inverse-quantized 8x8 block includes non-zero coefficient 
pixel; and 

10 (d) setting the HBS to "1" which means that the post-process is required, 

if on the leftmost colunm of the inverse-quantized 8x8 block includes non-zero 
coefficient pixel. 

7. The method of claim 5, wherein assimung that the uppermost and 
leftmost pixel of the block, among 64 pbcels constitutmg the 8x8 block, is pixel 

IS A, the pixel to the right of the pbcei A is a pixel B, and the pixel below the pixel 
A is a pixel C, the ringing semaphore (RS) of the intra-VOP is set to T which 
means post-processing is required, if any pixel other than the pixels A, B and C of 
the inverse-quantized 8x8 block has a non-zero coefficient. 

8. The method of claim 7, wherein assuming that the pixel to the right 
20 of the pixel C is a pixel D, the ringing semaphore of the intra-VOP is set to "1" 

which means post-processmg is required, if any pixel other than the pixels A, B, 
C and D of the inverse-quantized 8x8 block has a non-zero coefficient. 

9. The method of claim 2, wherein the blocking semaphore of the 
current inter-VOP comprises a horizontal blocking semaphore (HBS) and a vertical 

25 blocking semaphore (VBS), and assuming that a reference VOP comprises 
predetermined reference blocks, and the block of the reference VOP predicted by 
a motion vector (MVx,MVy) of a block Ac of the current inter- VOP is a motion 
block X, the HBS and the VBS of on the block Ac of the current inter-VOP are 
extracted by the steps of: 

30 checking the degree of overlapping between the motion block X and the 

reference blocks; 

performing a bit-wise AND operation on the HBS and VBS of the reference 
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blocks in which the number of the overlapped pixels is more than a predetermined 
nmnber; and 

setting the HBS and the VBS of the block Ac of the current VOP to the 
result of the operation. 
5 10. The method of claim 4, wherem assuming that a reference VOP 

comprises predetermined reference blocks, and the block of the reference VOP 
pfaiiaaby a motion vector (MVx,MVy) of a block Ac oflhecurrent inter- VOP 
is a motion block X, the ringing semaphore (RS) of the block Ac of the current 
inter- VOP is extracted by the steps of: 
10 setting the RS of the current block Ac to "1" if an inverse quantized 

coefficient (IQC) of a residual signal in the 8x8 block of the inter- VOP is non- 
zero; 

setting the RS of the block to "1" in an 8x8 prediction mode which is 
supported by the MPEG-4 algorithm and transfers four motion vectors on one 
15 macroblock (MB); and 

checking the degree of overlapping between the motion block X and the 
reference blocks, if the RS is still zero, and performing a bit-wise OR operation on 
the RS of the reference blocks in which the number of the overlapped pixels is 
more than a predetermined number, to set the RS of the block Ac of the current 
20 VOP to the result of the operation. 

11. The method of claim 9, wherein the predetermined number of the 
overl^ped pixels is 2x2 pixels. 

12. The method of claim 9, wherein filtering is performed by the steps 

of: 

25 (a) changing a predetermined number of pixel values of a horizontal block 

boundary between a block I and a block J adjacent to the block I if the HBSs of the 

blocks I and J are set to "1"; 

(b) comparing the difference between the values of two pixels adjacent to 

each other around the horizontal block boundary with a quantization factor (QP) of 
30 the H.263 if the HBS of either the block I or tiie block J is zero, and changing die 

values of die pixels whose number is less than in the step (a) if the difference of 

the pixels is less than the QP, 
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wherein the filtering on the pixels around the vertical block boundary is 
performed using the VBS in the same manner as in the pixels around the horizontal 
block boundary. 

13. The method of claim 12, wherein assuming six pixels around the 
5 horizontal block boundary between the blocks I and J are pixels A, B, C, D, E and 

F, the pbcels C and D are nearest to the horizontal block boundary, the pixels A 
and F are farthest to the horizontal block boundary, and the pixels B and E are 
located at the middle of the pixels A and C, and pixels D and F, low-pass filtering 
on the 6 pfacels is performed using a 7-tab (1,1,1,2,1,1,1) low pass filter in the step 
10 (a), and the filtering of the step (b) is performed on the pixels B, C, D and E, 

wherein assuming that the difference between the pixels C and D is d, the 
pbcels C and D are filtered as an average of the pbcels C and D, and the filtered 
pbcels B and E are different firom the pbcels B and E, respectively, by d/8. 

14. The method of claim 10, wherein the filtering step comprises the 
15 steps of: 

detecting horizontal and vertical edges of image data; and 
performing 2-dunensional adaptive signal filtering on an 8x8 block 
requirmg reduction of ringing noise, 

wherein assuming that a pixel within a block having a predetermined size 
20 is pixel[m][n], the pbcel to the right of the pixel[m][n] is pbcel[m][n+l], the pbcel 
to the left of the pbcel[m][n] is pfacel[m][n-l], the difference between the 
pixel[m][n] and ttie pbcel[m][n+l] is Al, and the difference between the 
pixel[m][n] and the pbcels[m][n+l] is A2, and the quantization factor of the H.263 
is QP, the horizontal edge detection is performed by a logical formula ((Al >QP) 
25 and (A2>QP)) or (Al >2QP) or (A2>2QP) wherein the pbcel[m][n] is determined 
as edge and edge map Edge[m][n] is set to "T if the logical fonnula is satisfied, 
and 

assuming that the pbcel above the pixel[m][n] is pbcel(m+l][n], the pbcel 
below the pbcel[m][n] is pael[m-l][n], the difference between the pixel[m][nl and 
30 the pixel[m+l][n] is A'l, the difference between the pfacel[m][nl and the 
pbcel[m-ll[n] is A'2, and the quantization factor of the H.263 is QP, the vertical 
edge detection is performed by a logical formula ((A'l >QP) and (A7>QP)) or 
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(A'l >2QP) or (A'2>2QP) wherein flie pixel[m][n] is determined as edge and edge 
map Edge[m][n] is set to "1" if the logical formula is satisfied, and 

signal adaptive filtering is performed by applying a 4-connected filter 
window to the 8x8 block, wherein filtering is not performed if the central pixel of 
5 the filter window is an edge, and weighted filtering is performed if the central pixel 
of the filter window is a non-edge pixel. 

^15. An edge detection method~for deringing filtering to reduce ringing 
noise, the method comprising the steps of: 

detecting a horizontal edge of image data; and 
10 detecting a vertical edge of the image data, 

wherein assuming that a pixel within a block having a predetermined size 
is pixel[m][n], the pixel to the right of the pixel[m]In] is pixel[m][n+l], the pixel 
to the left of the pixel[m][n] is pixel[m][n-l], the difference between the 
pixel[m][nl and the pixel[ml[n+l] is Al, and the difference between the 
15 pixel[m][n] and tiie pixels[m][n+l] is A2, and the quantization factor of the H.263 
is QP, the horizontal edge detection is performed by a logical formula ((Al >QP) 
and (A2>QP)) or (Al >2QP) or (A2>2QP) wherein the pixel[m][n] is determined 
as edge if the logical formula is satisfied, and 

assuming that the pixel above the pixel[m][n] is pixel[m+l][n], the pixel 
20 below the pbcel[m][n] is pixel[m--l][n], the difference between the pixel[m][n] and 
the pixel[m+l][n] is A'l, the difference h&twecn the pixel[m][n] and the 
pixel[m-l][n] is A'2, and the quantization factor of the H.263 is QP, the vertical 
edge detection is performed by a logical formula ((A'l >QP) and (A'2>QP)) or 
(A'1>2QP) or (A'2>2QP) wherein the pixel[m][n] is determined as edge if the 
25 logical formula is satisfied. 

16. A deringing filtering method for reducing ringing noise, comprising 
the steps of: 

detecting horizontal and vertical edges of image data; and 
performing 2-D signal adaptive flitting on the block requhrmg reduction of 
30 ringing noise, 

wherein assuming that a pixel within a block having a predetermined size 
is pixel[m][n], the pbcel to the right of the pixel[m][n] is pixel[m](n-l-l], the pixel 



wo 99/22509 



--PCT/KR98/003n 



26 

to the left of the pixel[m][n]. is pixel[ml[n-l]. the difference between the 
pixel[m][n] and the pixel[m][n+l] is Al, and the difference between the 
pixel[m][n] and the pixels[m][n+l] is A2, and the quantization factor of the H.263 
is QP, the horizontal edge detection is performed by a logical formula ((Al > QP) 

5 and (A2>QP)) or (Al >2QP) or (A2>2QP) wherein the pixel[m][n] is determined 
as edge if the logical formula is satisfied, and 

assuming tfiat"the pixel above the pixel[m][h] ispixel[m+l][n]7Bie pixef 
below the pixel[m][n] is pixel[m-l][n], the difference between the pixel[m][n] and 
the pixel[m+ll[n] is A'l, the difference between the pixel[m][n] and the 

10 pixel[m"l][n] is A'2, and the quantization factor of the H.263 is QP, the vertical 
edge detection is performed by a logical formula ((A'l >QP) and (A'2>QP)) or 
(A'l >2QP) or (A'2>2QP) wherein the pixel[m][nl is determined as edge if the 
logical formula is satisfied, and 

signal adaptive filtering is performed by applying a 4-connected filter 

15 window to the 8x8 block, wherein filtering is not performed if the central pixel of 
the filter window is an edge pixel, and weighted filtering is performed if the central 
pbcel of the filter window is a non-edge pixel. 

17. A method of detecting comer outliers occurring at the comer of a 
cross point where four blocks meet when image data compressed based on a block 

20 are decoded, assuming that four pixels around the cross point are pixels A, B, C 
and D, value[01 is A, value[l] is B, vahie[2] is C, value[31 is D, 
(A-hB+C+D+2)/4 is Average, and are pixels adjacent to the pixel A in 
the block to which the pixel A belongs, is a pixel diagonal to the pixel A, 5, 
and fi^ are pixels adjacent to the pixel B in the block to which the pixel B belongs, 

25 ^3 is a pixel diagonal to the pixel B, Cj and are pixels adjacent to the pixel C 
in the block to which the pixel C belongs, is a pixel diagonal to the pixel C, Dj 
and are pixels adjacent to the pixel D in the block to which the pixel D 
belongs, and D3 is a pbcel diagonal to the pixel D, the method comprising the steps 
of: 

30 . (a) conq)aring the difference between the value[0] and the Average with the 
quantization factor (QP) of the H.263, and counting the pixel A as the comer 
outlier candidate pixel if the difference is greater than the QP; 
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(b) perfonning the step (a) on the value[l], value[2] and value[3] to count 
the corresponding pixel as a comer outlier candidate pixel; and 

(c) detecting the pixel as a comer outlier pixel if the comer ouflier candidate 
pixel is only one, and detecting the candidate pixel having the greatest difference 

5 from (A3+B3+C3+D3+2)/4 as a comer outlier pixel if there are two or more 
comer outlier candidate pixels. 

18. A- method of compensatmg-for detected comer outliers occurring at 

the comer of a cross point where four blocks meet when image data compressed 
based on a blodc are decoded, assuming that four pixels around the cross point are 

10 pixels A, B, C and D, value[0] is A, value[l] is B, value[2] is C, value[3] is D, 
(A+B-hC+D+2)/4 is Average,^, and ^ are pixels adjacent to the pixel A in the 
block to which the pixel A belongs, ^ is a pixel diagonal to the pixel A, and 
are pixels adjacent to the pixel B m the block to which the pixel B belongs, is 
a pixel diagonal to the pixel B, C, and axe pixels adjacent to the pixel C in the 

15 block to which the pixel C belopgs, is a pixel diagonal to the pbcel C, Dj and Z)^ 
are pixels adjacent to the pixel D in the block to which the pixel D belongs, and 
is a pixel diagonal to of the pixel D, the method comprising (he steps of: 

compensating for flie pixel A as A' by (4A+B+C+2D+4)/8, the pixel Aj 
as A/ by (A'+3Ai+2)/4. the pbcel i\ as 4 ' by (A'+34^ +2)/4. if the comer 

20 outlier pixel is A and the difference between die pixels A and A3 is less than 
3QP/2; 

compensating for the pixel B as B' by (4B+C+D+2A+4)/8, the pixel Bi 
as Bi' by (B'+3^ +2)/4, the pixel ? aSaB ' by (B'+pA +2)/4, if the comer 
outlier pbcel is B and the difference b^een the pbcels B and B3 is less than 3QP/2; 
25 ccMnpensating for the pbcel C as C by (4C+D+A+2B+4)/8, the pixel Q 

as C,' by (C'+3q +2)/4, the pixel ? as^: ' by (C'+|C +2)/4, if the comer 
outlier pixel is C and the difference between the pixels C and C3 is less than 
3QP/2; and 

compensating for the pbcel D as D' by {4D+A+B4-2C-f 4)/8, the pixel Dj 
30 as D/ by (D'+3Di +2)/4, the pixel as p ' by (D'+3p H-2)/4, if the comer 
outlier pixel is D and the difference between the pixels D and D3 is less than 
3QP/2. 19. An image data post-processing method for reducing comer 
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outliers ocxxirring at the comer of a cross point where four blocks meet when image 
data compressed based on a block are decoded, the mefliod comprising the steps of: 
(a) detecting comer outliers from the block of inverse-quantized image data; 

and 

5 (b) compensating for the detected comer outliers, 

wherein assuming that four pixels around the cross point are pixels A, B, 
^C~and D, value[0] is A, value[l] is B, value[2] is C, value[3] is D, 
(A+B+C-l-D+2)/4 is Average, and ^ are pixels adjacent to the pixel A in 
the block to which the pixel A belongs. is a pixel diagonal to the pixel A, 5, 

10 and i?2 are pixels adjacent to the pixel B iu the block to which the pixel B belongs, 
^3 is a pixel diagonal to the pixel B, C, and are pixels adjacent to the pfacel C 
in the block to which &e pbcel C belongs, q is a pbcel diagonal to the pixel C, Z), 
and are pixels adjacent to the pixel D in the block to which the pbcel D 
belongs, and is a pfacel diagonal to die pfacel D, the step (a) comprises the sub- 

15 steps of: 

(al) con5>aring die difference between the value[0] and the Average with the 
quantization factor (QP) of the H.263, and counting the pfacel A as the comer 
outlier candidate pixel if the difference is greater than the QP; 

(a2) performing the step (al) on the value[l], value[2] and value[3] to count 

20 the correspondmg pfacel as a comer outlier candidate pixel; and 

(a3) detecting the pfacel as a comer outlier pfacel if the comer outlier 
candidate pfacel is only one, and detecting the candidate pfacel having the greatest 
difference from (A3+B3+C3+D3+2)/4 as a comer outlier pfacel if there are two or 
more comer outlier candidate pfacels, and 

25 wherein the stq) (b) is performed by compensating for the pfacel A as A' by 

(4A+B+C+2D+4)/8, the pfacel Aj as A, ' by (A' -f3A +2)/4, the pfacel i\ as 4 ' 
by (A' +3A2+2)/4, if the comer outlier pfacel is A and the difference between the 
pixels A and A3 is less than 3QP/2; compensating for the pixel B as B' by 
(4BH-C+D+2A+4)/8, the pfacel B, as B,' by (B'+3Bi +2)/4, the pfacel Q as ? ' 

30 by (B'+BA2+2)/4, if the comer outlier pfacel is B and the difference between the 
pixels B and B3 is less than 3QP/2; compensating for the pixel C as C by 
(4C+D+A+2B+4)/8, the pixel C, as C, ' by (C'+3q +2)/4, the pixel Q as Q ' 



wo 99/22509 



PCT/KR98/00311 



29 

by (C'+3C2+2)/4, if the comer outlier pixel is C and the difference between the 
pixels C and €3 is less than 3QP/2; and compensating for the pixel D as D' by 
(4D+A+B+2C+4)/8, the pixel Di as Dj' by G)'+3Dj+2)/4, the pixel as Q ' 
by (D'+3D2+2)/4, if the comer outlier pixel is D and the difference between the 
5 pixels D and D3 is less than 3QP/2. 

20. An image data post-processing method for reducing quantization 
effect induced when image data compressed based on a block is decoded, the 
method comprising the steps of: 

(a) detecting semaphore representing whether or not post-processing is 
10 required, using distribution of inverse quantization coefficients of inverse-quantized 

image data and a motion vector representing the difference between blocks of 
previous video object plane (VOP) and blocks of a current VOP; and 

(b) detecting a comer outlier pbcel of the inverse-quantized image data 
blodc, assuming that four pixels around the cross point are pixels A, B, C and D, 

15 vahie[0] is A, value[l] is B, value[2] is C, value[3] is D, (A+B+C+D+2)/4 is 
Average, and are pixels adjacent to the pixel A in the block to which the 
pixel A belongs, is a pixel diagonal to the pixel A, jB^ and are pixels 
adjacent to the pixel B in the block to which the pixel B belongs, £3 is a pixel 
diagonal to the pixel B, C, and are pixels adjacent to the pixel C in the block 

20 to which the pixel C belongs, C3 is a pbcel diagonal to the pixel C, D, and are 
pixels adjacent to the pixel D in the block to which the pixel D belongs, and 
is a pixel diagonal to the pixel D, by the steps of: 

(bl) con^)aring the difference between the value[0] and the Average 
with the quantization factor (QP) of the H.263, and counting the pbcel A as the 

25 comer outlier candidate pixel if the difference is greater than the QP; and 

G>2) performmg the step (bl) on the value[l], value[2] and value[3] 
to count the corresponding pixel as a comer outlier candidate pixel; 

(c) filtering the decoded image data corresponding to the semaphore by a 
predetermined method, if it is determined by checking the detected semaphore that 

30 the post-process is required; and 

(d) detecting the pbcel as a comer oudier pbcel if the comer outlier candidate 
pbcel is only one and then compensating for the pixel by a predetermined method 
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if the difference between the pixel and a pixel diagonal to the pixel is less than 
3QP/2, and detecting the candidate pixel having the greatest difference from 
(A3+B3+C3+D3+2)/4 as a comer outtier pixel if there are two or more comer 
outlier candidate pixels and then compensating for the detected candidate pixel by 
S the predetermined method. 

21. The method of claim 20, wherein if the detected comer outlier pixel 
is A and theHifference between the^ixels A and A3 is less than 3QP727 the pixel 
A is compensated for as A' by (4AH-B+C+2D+4)/8, the pixel A, as A ' by 
(A'+3Ai+2)/4, the pixel as 4 ' by (A'+3A +2)/4, and if the detected comer 

10 outlier pixel is B and the difference between the pixels B and B3 is less than 3QP/2, 
the pbcel B is compensated for as B' by (4B+C+D+2A+4)/8, the pixel Bj as B^' 
by (B'+3Bi+2)/4, the pixel as ^ ' by (B'+3? +2)/4, and if the detected comer 
outlier pixel is C and the difference between the pixels C and C3 is less than 
3QP/2, the pixel C is compensated for as C by (4C+D+A+2B+4)/8, the pixel 

15 Ci as q ' by (C'+SQ +2)/4, Ae pkel p as^ ' by (C'+|C +2)/4. and if the 
detected comer outlier pbcel is D and the difference between the pixels D and 
is less than 3QP^, the pixel D is compensated for as D' by (4D+A+B+2C+4)/8, 
die pixel D, as D/ by (D'+3Di +2)/4, the pael Q as Q ' by (D'+3]? +2)/4. 

22. An image data post-processing apparatus for reducing quantization 
20 effect induced when image data compressed based on a block is decoded, the 

apparatus comprising: 

a semaphore detector for detecting a senu^hore representing whether or not 
post-processing is required, using distribution of inverse quantization coefficients 
of inverse-quantized image data and a motion vector representing the difference 
25 between blocks of previous video object plane (VOP) and blocks of a current VOP; 

a deblocking fdter for checking blocking semaphore detected by the 
semaphore detector aiKi performing deblocking filtering on the decoded image data; 

a corner outlier compensator for detecting a comer outlier from the data 
passed through the deblocking filtering and compensating for die detected comer 
30 outlier; and 

a deringing filter for checking ringing semaphore detected by the semaphore 
detector and performing deringing filtering on the comer outlier compensated data. 
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wherein the semaphore includes a blocking semaphore representing whether 
or not reducing blocking artifacts near block boundaries is required, and a ringing 
semaphore representing whether or not reducing ringing noise near image edges is 
required. 

5 23. The apparatus of claim 22, wherein the semaphore detector detects 

the semaphore on an intra-VOP and an inter- VOP, and the semaphore detection on 
tthe intra-VOP is performed by using the distribution" of inverse quantization 
coefficients which are discrete cosine transform (DCT) coefficients of the inverse- 
quantized image data, and the semaphore detection on the inter- VOP is performed 
10 using the motion vector representing the difference between the blocks of previous 
VOP and the blocks of the current VOP. 

24. The apparatus of claim 22, wherein the deblocking filter is 1- 
dimensional horizontal and vertical low pass filters. 

25. The apparatus of claim 22. wherem the deringing filter is a 2- 
15 dimensional signal adaptive filter. 

26. A computer readable medium having embodied thereon a computer 
program for image data post-processing cs^able of reducmg quantization effect 
induced when image data compressed based on a block is decoded, 

wherein the image data post-processing method comprises the steps of: 
20 detecting a semaphore representing whether or not post-processing is 

required on an intra video object plane (VOP) in an intra-VOP mode and an inter- 
VOP in an inter-VOP mode, by investigating the distribution of inverse quantization 
coefficients of inverse-quantized image data and calculating a motion vector 
representing die difference between die blocks of previous VOP and tiie blocks of 
25 flie current VOP; and 

filtering the decoded image data corresponding to the semaphore by a 
predetermined method, if it is determined by checking the detected semaphore that 
post-processing is required. 

27. The computer readable medium of claim 26, wherein the semaphore 
30 includes a blocking semaphore representing whether or not reduction of blocking 

artifacts near block boundaries is required, and a ringing semaphore representing 
whether or not reduction of ringing noise near image edges is required, and 
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assuming that the uppermost and leftmost pixel of the block, among 64 
pixels constituting the 8 x8 block, is pkel A, the pixel to the right of the pixel A 
is a pixel B, and the pbcel below the pixel A is a pixel C, when the blocking 
semaphore of the intra-VOP conq)rises a horizontal blocking semaphore (HBS) and 
5 a vertical blockmg semaphore (VBS), the HBS and the VBS of the intra-VOP are 
extracted by the steps of: 

(a) "calculatmg discrete cosine transforin'CDCT) coefficients on thelnverse- 
quantized 8x8 block after the compressed image data is inversely quantized; 

(b) setting the HBS and the VBS to "1" which means that post-processmg 
10 is required, if only the coefficient of the pixel A is non-zero; 

(c) setting flie VBS to T which means that post-processmg is required, if 
only the top row of the inverse-quantized 8x8 block includes non-zero coefficient 
pixel; and 

(d) setting the HBS to **r which means that the post-process is required, 
IS if on the leftmost column of the inverse-quantized 8x8 block mcludes non-zero 

coefficient pbcel, and 

the ringing semaphore (RS) of the intra-VOP is set to "T which means 
post-processing is required, if any pixel other than the pfacels A, B and C of the 
inverse-quantized 8x8 block has a non-zero coefficient, and 

20 the blocking semaphore of the current inter-VOP comprises a horizontal 

blocking semspboro (HBS) and a vertical blocking semaphore (VBS), and assuming 
that a reference VOP comprises predetermined reference blocks, and the block of 
the refCTence VOP predicted by a motion vector (MVx,MVy) of a block Ac of the 
current inter-VOP is a motion block X, the HBS and the VBS of on the block Ac 

25 of the current inter-VOP are extracted by the steps of: 

checking the degree of overlapping between the motion block X and the 
reference blocks; 

performing a bit-wise AND operation on the HBS and VBS of the reference 
blocks in which the number of the overlapped pbcels is more than a predetermined 
30 number; and 

setting the HBS and the VBS of the block Ac of the current VOP to the 
result of the operation. 
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28. The computer readable medium of claim 26, wherein assummg that 
a reference VOP comprises predetermined reference blocks, and the block of the 
reference VOP predicted by a motion vector (MVx,MVy) of a block Ac of the 
cuixent inter-VOP is a motion block X, the ringing semaphore (RS) of the block 

5 Ac of the current inter-VOP is extracted by the steps of: 

setting the RS of the current block Ac to "1" if an inverse quantized 
coefficient_(IQCXolaj:BsiduaLsignal in the Sxg-block of the inter-VOP-is-non- 
zcro; 

setting the RS of the block to T m an 8x8 prediction mode which is 
10 supported by the MPEG-4 algorithm and transfers four motion vectors on one 
macFoblock (MB); and 

checking the degree of overlapping between the motion block X and the 
reference blocks, if the RS is still zero, and performing a bit- wise OR operation on 
the RS of the reference blocks in which the number of the overlapped pixels is 
15 more than a predetermined number, to set the RS of the block Ac of the ciui:ent 
VOP to the result of the operation. 

29. The computer readable medium of claim 26, wherein filtering is 
performed by the steps of: 

(a) changing a predetermined number of pixel values of a horizontal block 
20 boundary between a blodc I and a block J adjacent to the block I if the HBSs of the 

blocks I and J are set to "1"; 

(b) con^)aring the difference between the values of two pixels adjacent to 
each odi^ around the horizontal blodc boundary with a quantization factor (QP) of 
tiieH.263 if the HBS of either the block I or the block J is zero, and changing the 

25 values of the pixels whose number is less than in the step (a) if the difference of 
the pixels is less than the QP, 

wherein the filtering on the pixels around the vertical block boundary is 
performed using the VBS in the same manner as in the pixels around the horizontal 
block boundary, and 

30 assuming six. pfacels around the horizontal block boundary between the 

blocks I and J are pixels A, B, C, D, E and F, the pixels C and D are nearest to 
the horizontal block boundary, the pixels A and F are farthest to the horizontal 



wo 99/22509 



PCT/KR98/00311 



34 

block boundary, and the pixels B and E are located at the middle of the pixels A 
and C, and pixels D and F, low-pass filtering on the 6 pixels is performed using 
a 7-tab (1,1,1,2,1,1,1) low pass filter in the step (a), and the filtering of the step 
(b) is performed on the pixels B, C, D and E, 
5 wherein assummg that the difference between the pixels C and D is d. the 

pixels C and D are filtered as an average of the pixels C and D, and the filtered 
pixels B and E are different-from"the~pixels'Bmd~Er respect^ by d/8. 

30. The computer readable medimn of claim 28, wherein the filtering 
step comprises the steps of: 
10 detecting horizontal and vertical edges of image data; and 

performing 2-dimensional adaptive signal filtering on an 8x8 block 
requiring reduction of ringing noise, 

wherein assuming that a pixel within a block having a predetermined size 
is pixel[m][n], Ihe pixel to the right of the pixel[m][n] is pixel[m][n+l], the pixel 
15 to the left of the pixel[m][n] is pixel[m][n-l], the difference between the 
pixel[m][n] and the pixel[m][n+ll is Al, and the difference between the 
pixel[m][n] and the pixels[m][n+l] is A2, and the quantization factor of the H.263 
is QP, the horizontal edge detection is performed by a logical formula ((A1>QP) 
and (A2>QP)) or (Al >2QP) or (A2>2QP) wherein the pixel[m][n] is detennined 
20 as edge and edge map Edge[ml[n] is set to "1" if the logical formula is satisfied, 
and 

assuming that the pixel above the pixel[m][n] is pixel[m+l][n], the pixel 
below the pfacel[m][n] is pfacel[m-l][n], the difference between the pfacel[m][n] and 
the pixel[m+l][n] is A'l, the difference between the pixel[m][n] and the 

25 pixel[m-l][n] is A'2, and the quantization factor of the H.263 is QP, flie vertical 
edge detection is performed by a logical formula ((A'1>QP) and (A'2>QP)) or 
(A'1>2QP) or (A'2>2QP) wherein the pixel[m][n] is determined as edge and edge 
map Edge[m][n] is set to T if the logical formula is satisfied, and 

signal adaptive filtering is performed by applying a 4-connected filter 

30 wiiKiow to the 8x8 block, wherein filtering is not performed if the central pixel of 
the filter window is an edge, and weighted filtering is performed if tiie centtal pixel 
of the filter window is a non-edge pixel. 
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31. A computer readable medium having embodied thereon a computer 
program for image data post-processing capable of reducing comer outliers 
occurring at the comer of a cross point where four blocks meet when image data 
compressed based on a block are decoded, 
5 wherein the image data post-processing method comprises the steps of: 

(a) detecting comer outliers from the block of inverse-quantized image data; 
and 

(b) compensating for the detected comer outliers, 

wherein assuming that four pixels around the cross point are pixels A, B, 
10 C and D, value[0] is A, value[l] is B, value[2] is C, value[3] is D, 
(A+B+C-f D+2)/4 is Average, and are pixels adjacent to the pixel A in 
the block to which the pixel A belongs, ^ is a pixel diagonal to the pixel A, 5, 
and ^ are pixels adjacent to the pixel B in the block to which the pixel B belongs, 
^3 is a pbcel diagonal to the pbcel B, C, and ^ Pixels adjacent to the pkel C 
IS in the block to which the pixel C belongs, is a pbcel diagonal to the pixel C, 
and D2 are pbcels adjacent to the pbcel D in tibe block to which the pixel D 
belongs, and D3 is a pixel diagonal to the pixel D, the step (a) comprises the sub- 
steps of: 

(al) conq>aring the dififerenoe between the vahie[0] and the Average with the 
20 quantization factor (QP) of the H.263, and counting the pixel A as the comer 
outlier candidate pbcel if the difference is greater than the QP; 

(a2) performing the step (al) on Ihe value[l], vahie[2] and value[3] to count 
the corresponding pbcel as a comer ovAicr candidate pixel; and 

(a3) detecting the pbcel as a comer outlier pixel if the comer outlier 
25 candidate pixel is only one, and detecting the candidate pixel having the greatest 
difference from (A3+B3+C3+D3+2)/4 as a comer outlier pbcel if there are two or 
more comer outlier candidate pixels, and 

wherein the step (b) is performed by conq)ensating for the pbcel A as A' by 
(4A+B+C+2D+4)/8, the pbcel A, as A/ by (A'+3A +2)/4, the pbcel A as A ' 
.30 by (A'+3A2+2)/4, if the comer outlier pbcel is A and the difference between the 
pixels A and A3 is less than 3QP/2; compensatmg for the pbcel B as B' by 
(4B+C+D+2A+4)/8. the pbcel B, as B,' by (B'+3Bi -l-2)/4. the pbcel Q as ? ' 
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by (B'+BA2+2)/4, if the comer outlier pixel is B and the difference between the 
pixels B and Bj is less than 3QP/2; conq)ensatuig for the pixel C as C by 
(4C+D+A+2B+4)/8. the pixel C, as Q' by (C'+3Q +2)/4, the pixel Q as q ' 
by (C'+3C2+2)/4, if the comer ouUier pixel is C and the difference between the 
5 pixels C and C, is less than 3QP/2; and compensating for the pixel D as D' by 
(4D+A+B+2C+4)/8. the pixel D, as D,' by (D'+3D, +2)/4, the pixel as Dj' 
-by-(DM-aD2+2)/4rif-the^»nier outlier pixel is D and the difference-between the- 
pixels D and D3 is less than 3QP/2. 
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